WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 
G06F 17/30 



Al 



(11) International Publication Number: WO 98/43183 

(43) International Publication Date: 1 October 1998 (01.10.98) 



(21) International Application Number: PCT/US98/05684 

(22) International Filing Date: 23 March 1998 (23.03.98) 



(30) Priority Data: 

08/827,035 



25 March 1997 (25.03.97) 



US 



(71) Applicant: SONY ELECTRONICS, INC. [US/US]; 1 Sony 

Drive, Park Ridge, NJ 07656 (US). 

(72) Inventors: LEG ALL, Loretta, C; 1235 Lisa Lane, Los Altos 

CA 94024 (US). MASLI, Hans; 41 17 Seafel Drive, Sari 
Jose, CA 95134 (US). KULAS, Charles, J.; 244 Texas 
Street, San Francisco, CA 94107 (US). 

(74) Agents: SOBRINO, Maria, E. et al.; Blakely, Sokoloff, 
Taylor & Zafman, 7th floor, 12400 Wilshire Boulevard, Los 
Angeles, CA 90025-1026 (US). 



(81) Designated States: AL, AM, AT, AT (Utility model), AU, AZ 
BA, BB, BG, BR, BY, CA, CH, CN, CU, CZ, CZ (Utility 
model), DE, DE (Utility model), DK, DK (Utility model), 
EE, EE (Utility model), ES, FI, FI (Utility model), GB, GE, 
GH, GM, GW, HU, ID, IL, IS, JP, KE, KG, KP, KR, KZ, 
LC, LK, LR, LS, LT, LU, LV, MD, MG, MK, MN, MW, 
MX, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SK 
(Utility model), SL, TJ, TM, TR, TT, UA, UG, UZ, VN, 
YU, ZW, ARIPO patent (GH, GM, KE, LS, MW, SD, Sz] 
UG, ZW), Eurasian patent (AM, AZ, BY, KG, KZ, MD, 
RU, TJ, TM), European patent (AT, BE, CH, DE, DK, ES, 
FI, FR, GB, GR, IE, IT, LU, MC, NL, PT, SE), OAPI patent 
(BF, BJ, CF, CG, CI, CM, GA, GN, ML, MR, NE, SN, TD, 
TG). 



Published 

With international search report. 
Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) Title: INTEGRATED SEARCH OF ELECTRONIC PROGRAM GUIDE, INTERNET AND OTHER INFORMATION RESOURCES 



(57) Abstract 

A power search tool that enables a 
user to search an electronic program guide 
and other information resources with one 
search. A search tool window (302) is 
displayed that enables a user to select fil- 
ter elements (304) used to search. Alter- 
nately, in one embodiment, the filter ele- 
ments (304) are automatically selected from 
predetermined program elements, such as 
title or subject, of a selected program in 
the electronic program guide. The search 
tool performs a search of the electronic pro- 
gram guide (306) and information resource 
and modifies the display of the electronic 
program guide (316) to identify those pro- 
grams that are filtered from the search. Sim- 
ilarly, a window (324) displays information 
indicating those portions of the information 
resource that have been filtered during the 
search. Preferably the information resource 
is the world wide web and the URLs of the 
web sites that include information relative 
to the filter elements (304) are displayed. 
The user can then view the electronic pro- 
gram guide (320) and select broadcasts of 
programs to display as well as proceed to 
the web sites indicated simply by selection 
of the corresponding elements on the dis- 
play. 
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INTEGRATED SEARCH OF ELECTRONIC PROGRAM GUIDE, 
INTERNET AND OTHER INFORMATION RESOURCES 

BACKGROUND OF THE INVENTION 

1 . FIELD OF THE INVENTION 

The present invention is directed to a search utility 
that enables a user to search for and to access information 
from a variety of information resources. 

2. ART BACKGROUND 

Information is available from a variety of 
information resources. For example, a user can acquire 
information from the World Wide Web. In addition, many 
broadcasts, such as those sent via satellite and cables, 
include information regarding the broadcast that enables 
the construction of an electronic program guide that can 
be displayed on the broadcast display device or other 
display device. 

Multimedia capability available on today's 
computers enable a user to view data as well as graphical 
information including video, audio or broadcast programs 
on the user's desktop. Thus, the desktop can consist of 
and access a variety of information resources. To search 
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these resources, the user often has to create and re- 
execute queries for each of the different types of 
resources available. This is quite cumbersome. It is 
therefore desirable to perform searches that can be 
carried across a variety of information platforms. 



SUMMARY OF THE INVENTION 



The system and method of the present invention 
provides an integrated search tool for specifying and 
searching a variety of information resources. In one 
embodiment, the search tool is used for searching 
broadcast information and Internet information using a 
single user-initiated search. The search criteria can be 
saved as a filter, which can be executed at a later time. 
Results of the search are presented to the user. The user 
can then display available Web sites and/or an electronic 
program guide (EPG) containing program information that 
meets the search criteria. Via the EPG, broadcasts can be 
selected and displayed on the display. Thus, the user can 
access broadcast information and Internet information on 
the same search topic and criteria without performing 
multiple searches or recreating the search criteria. 



BRIEF DESCRIPTION OF THE DRAWINGS 
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The objects, features and advantages of the present 
invention will be apparent to one skilled in the art in the 
following detailed description in which: 

Figure 1 is a simplified block diagram of the system that 
operates in accordance with the teachings of the present 
invention; 

Figures 2 illustrates an exemplary search result of the 
power search tool of the present invention; 

Figures 3a, 3b, and 3c present an overview of the 
functionality provided by the power search tool of the 
present invention; 

Figure 4 illustrates steps performed to create a filter used 
to search broadcast information and Internet information 
in accordance with the teachings of the present invention; 

Figure 5 illustrates the steps performed to activate a 
search; and 

Figure 6 illustrates the steps performed to render on a 
display the query of the results of the search performed. 



DETAILED DESCRIPTION 
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In the following description for purposes of 
explanation, numerous details are set forth in order to 
provide a thorough understanding of the present 
invention. However, it will be apparent to one skilled in 
the art that these specific details are not required in order 
to practice the present invention. In other instances, well 
known electrical structures and circuits are shown in block 
diagram form in order not to obscure the present 
invention unnecessarily. 

A simplified block diagram of a system which 
incorporates the system of the present invention is 
illustrated in Figure 1. A variety of systems may be used. 
For example, a multimedia computer, such as the Sony PC 
manufactured by Sony Corporation may be utilized. The 
system 100 typically includes a central processing unit 
(CPU) 130, memory 135, input/output circuitry 125, as 
well as other circuitry and components that are well 
known to those skilled in the art. The system 100 will 
output information to a display 120 and, may also provide 
audio through speakers 126. The information may be 
received through receiver 105. Receiver 105 in one 
embodiment is a satellite receiver for receiving satellite 
transmissions of broadcasts and programming information 
through antenna 106. Using the programming information 
received through receiver 105, the system 100 can 
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generate an electronic program guide (EPG) on the display 
120. As will be described below, the EPG can be modified 
or filtered according to the searching performed by the 
user using the power search tool described herein. 

The user can provide input to the system 100 
through a user input device 115 which may include a 
keyboard, mouse, remote control or other input device. 
The system 100 further has access to the Internet through 
Internet access 110, and also can access previously 
accessed and stored web pages. Using this access 
mechanism, which may be an Internet provider or other 
connection to the Internet, the user can search for external 
information including information available on the World 
Wide Web and previously broadcasted Web pages. It is 
readily apparent that the system is not limited to Internet 
access, and can access a variety of external or internal 
resources including third party databases. 

The display, as shown for example in Figure 2, can 
include a variety of information, such as web sites and 
television broadcasts. For example, referring to Figure 2, 
the display may include a program currently being 
broadcast in area 205, HTML frame 210, which may 
display a list of web sites or a particular web site 215, 
and/or electronic program guide of broadcast information 
220, and a tool area, which enables the user to manipulate 
the information and resources used and the information 
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displayed including the power search tool that is described 
below. In the present embodiment, Window 210 is 
executing a Web browser application (such as Mosaic® or 
Netscape®) that uses a Yahoo® search engine to search the 
World Wide Web. The browser displays the search results 
of the query in the Window 210. Using the browser, the 
user can switch from one site to another seamlessly. 
Uniform resource locator (URL) information also is 
displayed; the integration is seamless as the user can 
select sites to view by selection of the corresponding URL 
or alternately via utilization of the browser or search 
engine. Window 220 adapts the EPG window to display 
the result of broadcast data query. Immediate tune-in is 
available by selection of a current EPG element in the 
Window 220. 

An overview of the power search tool is illustrated 
in the flow diagram of Figure 3a, the diagram of Figure 3b 
and diagram of Figure 3c. The power search tool includes 
query tools for specifying and selecting the filter elements 
used to perform the search. The user can select the 
information sources to be searched, such as the World 
Wide Web and electronic program guide (EPG) 
information. In the present embodiment, the World Wide 
Web and EPG information are accessed; however, it is 
readily apparent that the resources can be expanded to 
include other resources, and furthermore, that one, some, 
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or all of the resources can be selected for searching. The 
user can also invoke commands to perform a search, stop a 
search, import information for performing the search, as 
well as maintaining logs of searches performed for 
subsequent references. Furthermore, the user can select 
what is to be searched and displayed, such that only web 
information is displayed, EPG information is only 
displayed, or all information is displayed. 

Referring to Figure 3a, a user, using a search tool 
window 302 (e.g., window 375, Figure 3b), can establish 
the topics that form elements of a filter 304 that is input 
to a search engine 306. The search engine 306 interacts 
with the different information resources, e.g., internet 312, 
cable broadcast 310 and satellite broadcast 308, to 
generate a result set 314 of information. This set 314 is 
applied to the EPG 316 to modify the EPG 316 to display or 
highlight those programs that meet the filter 
requirements. These results are displayed in the EPG area 
320 of the display 322. The display may be part of a 
television and/or processing device 326. Similarly the 
result set 314 can be sent to the browser 318 to provide 
the results of a web search in a browser or HTML based 
window 324. As noted earlier, the EPG can be used to 
tune to a broadcast by selection of an EPG element (e.g., 
program listing). The video is displayed in window 330 
and the audio is preferably output through speakers 328. 
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Figure 3b illustrates one example of a display which 
includes the search tool of the present invention. The 
window 375 includes a topic area 340 in which the user 
can define the topic which is the subject of the filter. The 
present embodiment includes a listing 342 of previously 
used topics. This enables the user to easily select a prior 
topic. The listing 342 is preferably automatically updated 
to include each new topic as is it used by the user. The 
search tool also includes searching categories 344 and 
subcategories 346 which are selectable by the user. As is 
readily apparent, the system can be configured to include 
a variety of categories and corresponding subcategories. 
The sources to be searched 341 are also selectable. Other 
parameters included in the present embodiment are the 
program rating 340, program start time 342, program 
length 344 , program cost 343 and the web search engine 
utilized 347. Once the user selects to proceed with the 
search, e.g., using "go" button 348 the window is shifted to 
display the power search result window (e.g., window 210, 
Figure 2). The EPG is also updated to reflect those 
programs that meet the filter criteria (see e.g., window 
220, Figure 2). In the present embodiment, filter button 
349 is provided. The selection of the filter button brings 
up a subwindow (not shown) of additional filter features. 
For example, the user can save and recall the current and 
previously saved filter elements, respectively. The stop 
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button 350 allows the user to terminate the search if 
desired. Figures 3a and 3b illustrate one embodiment; the 
block diagram of Figure 3c illustrates a variety of features 
and functions that can be used. 

In addition, the user can maintain filter logs that 
reflect the filter terms used to perform the search. These 
logs can be selected, such that the search can be re- 
performed at a later time. The first step in the process is 
the creation of a filter to be used. This process is 
described with reference to Figure 4. Text strings 401 are 
entered or selected for the topic list which indicate the 
topic or terms to be used to perform the search. In block 
402, the text can be entered by typing in information, or 
importing information from the EPG 404, such as the 
current title of a program currently being broadcasted on 
the user's desktop display 205. Logical operators can be 
used 408 to combine multiple terms. An existing filter can 
be used 410 by selecting existing filters from the filter log 
412. In addition, filters or search terms can be acquired 
from information associated with a broadcast 414. For 
example, information such as broadcast categories 415 
(news, sports, drama, etc.), cost 416, rating 420, length 
422, start time 424, and end time 426 are examples of 
parameters supplied by the broadcast system for 
generation of an electronic program guide. This 
information can be used to generate the filters used to 



WO 98/43183 



PCT/US98/05684 



-10- 

perform the search. All or some of these filters and terms 
can be used. The search is flexible to select one or a 
plurality of information resources. In the present 
embodiment, the user can select 428 to search the World 
Wide Web 430 or an electronic program guide 432. It is 
readily apparent to one skilled in the art that other 
resources may be used. 

Once the filter is created, and the "Go" button is 
selected, the search is activated. The process is illustrated 
with respect to Figure 5. Commands 501 are used to 
specify certain parameters. After a search is initiated 502 
using the active filter specified 504, the search mechanism 
conducts a search of the World Wide Web 506, and the 
EPG 508. At any time the search may be stopped 510; the 
filters added to the filter log 511, the present filter delete 
from the log 514 or edited 516, resulting in an updated 
filter log 518. Using the filter specified, the system 
automatically generates the query to perform the search 
on the web and/or on the EPG. This can be performed a 
number of ways recognized by those skilled in the art. For 
example, a script can be generated that executes the 
sequence of commands needed to access the web and 
perform the search using existing search engines or a 
specially created search engine. Similarly, the search is 
performed on the EPG using a search tool. The search tool 
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may be a simple text search tool or database search tool, 
or a tool specifically written for searching the EPG. 

Once the search has been performed, the results are 
presented to the user. This is illustrated by the flow 
diagram of Figure 2 and the exemplary display shown in 
Figure 6. Referring to Figure 6, results can be formatted a 
number of ways. In the present embodiment, the result 
604 of any web searches 605 are presented in an HTML 
frame 610 on the display. For example, if multiple web 
sites meet the search criteria, the user may be presented a 
listing of web sites with the ability to move a cursor over 
to a web site URL and select the URL to bring up the 
particular web site. Alternately, a first web site can be 
automatically brought to the user's display or multiple 
web sites can be displayed, and the user can go forward or 
back across the multiple sites inside the HTML window. 

The results of the search performed on the electronic 
program guide 615 are displayed a variety of ways. For 
example, the EPG is modified to only display those 
programs that meet the search criteria. This is illustrated 
in Figure 2 in window 220. Alternatively, the areas of the 
EPG corresponding to programs that meet the criteria are 
highlighted by a different color. Furthermore, in one 
embodiment, the user is able to change the current 
broadcast 625 to one of the programs currently broadcast 
that meet the search criteria. For example, this might be 
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done by selecting a program from the modified EPG. 
Selection maybe achieved a variety of ways. For example, 
the user may indicate selection by using a remote control 
to enter the station number ID or by moving the cursor to 
point to the desired program. The system then responds 
by tuning to the program selected (the program being one 
of the programs that meets the search criteria). 

In an alternative environment, the search is initiated 
in the background by the selection of a program in the 
EPG. Preferably, the filter elements of a selected program, 
such as a particular broadcasted program on the user's 
desktop display, are determined from selected program 
elements of the EPG. For example, providers of satellite 
broadcasts provide electronic program guide streams from 
which the receiver devices can generate electronic 
program guides visible to the user. This information 
typically includes the title, abstract of the program, 
duration of the program, time of broadcast, and lead 
actors in the program. Upon selection of a particular 
broadcast to view, a background search can automatically 
be initiated using all or some of the parameters of the 
program element information provided with the program. 
For example, if the broadcast is a movie called "X", a 
search initiated by title could bring up the web site about 
the "X" movie. Alternately, if the broadcast is a show 
directed to the subject of whales, for example, a search can 
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be initiated based on the abstract on the topic of whales, 
and web sites directed to that topic would automatically 
be provided to the user. Thus, the user would 
automatically receive information on a subject of interest 
from a variety of resources. 

In either of the environments discussed above, the 
information associated with a broadcast can be more than 
just a sequence of keywords. Keywords can be combined 
with logical syntactic operators such as AND, OR and NOT 
to produce boolean combinations of search terms and to 
provide a more intelligent query. For example, a popular 
search engine is the one provided by the Alta Vista site 
www.altavista.digital.com. Either the simple query or 
advanced query syntax as documented at this site may be 
used. Other query syntax may be used. 

Additionally, a complete search query can be 
provided in association with a broadcast. That is, a string 
of keywords combined with operators can be included in 
the EPG associated with a broadcast, included in the 
vertical blank interval of a broadcast signal itself, included 
in an Internet server "push" of data to the system of the 
present invention in association with a broadcast program, 
etc. That is, the search query can be formed at the 
content-provider end rather than having the system at the 
user end construct the query. 
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As another refinement, search results can be 
provided by the content-provider so that the receiving 
user system does not have to perform a search. This last 
approach has the advantage of eliminating the unrelated 
information that may turn up from an Internet search but 
has the drawback that a large amount of information in 
the form of URL information must be transmitted. Still, 
where the number of URLs transmitted is small, this last 
approach may be the most efficient. 

In one embodiment, this search is performed in the 
background so as not to disturb foreground processes, 
such as display of a broadcast or video. If the search 
identifies related web sites, for example, a discreet 
animated alert is provided to the user, for example, in the 
user's tools area, enabling the user to selectively bring up 
the related web sites by selecting the alert. If the user 
selects to view the web sites, the web sites are then 
displayed in the HTML window provided on the user's 
desktop display. 

The invention has been described in the context of a 
preferred embodiment. It is readily apparent to one 
skilled in the art that numerous alternatives, modification, 
variations and uses will be apparent to those skilled in the 
art in light of the foregoing description. 
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CLAIMS 

What is claimed is: 

1. A power searching method comprising the 
steps of: 

providing a search tool window (302) that enables 
the generation of filter elements (304) for selectively 
searching an electronic program guide and at least one 
information resource; 

selecting filter elements (304) for a search; 

instituting a search of an electronic program guide 
(306) and the at least one information resource using the 
filter elements (304); 

generating a result set (314) of search results; 

applying the result set (314) to an electronic 
program guide window (316) to modify the guide to 
indicate those programs that meet the filter elements 
(304); and 

generating an information resource window (324) 
displaying results of the search of the at least one 
information resource based upon the filter elements (304). 

2. The method as set forth in claim 1, further 
comprising the step of 

providing an audio/visual window (330) comprising 
a broadcast of a program. 

3. The method as set forth in claim 2, further 
comprising the step of said user selecting a program to be 
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displayed in the audio/visual window (330) by selecting a 
program from the modified electronic program guide 
(320). 

4. The method as set forth in claim 1, wherein 
the at least one information resource is the world wide 
web and the information resource window (324) displays 
a list of URLs of web sites that are part of the result set of 
search results. 

5. The method as set forth in claim 1, wherein 
the at least one information resource is the world wide 
web and the information resource window (324) 
comprises a web browser that displays a list of URLs of 
web sites that are part of the result set of search results. 

6. The method as set forth in claim 1, wherein 
the step of selecting filter elements (304) for a search is 
performed by a user. 

7. The method as set forth in claim 1, wherein 
the step of selecting filter elements (304) for a search is 
automatically determined from program elements of a 
selected program from the electronic program guide (316). 

8. The method as set forth in claim 7, wherein 
the step on initiating a search is performed in the 
background when a broadcasted program is selected for 
display. 
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9. In a system comprising a processor (130), 
memory (135) and a display (120), a power search tool 
comprising: 

an electronic program guide window (220) 
comprising an electronic program guide; 

a search tool window (302) configured to enable the 
generation of filter elements (304) for selectively 
searching an electronic program guide and at least one 
information resource; and 

logic configured to search the electronic program 
guide (306) apply the result set to the electronic program 
guide window (316) to modify the electronic program 
guide displayed (320) to indicate those programs that 
meet the filter elements (304) and to generate an 
information resource window (324) displaying results of 
the search of the at least one information resource based 
upon the filter elements (304). 

10. The system as set forth in claim 9, further 
comprising an audio/visual window (330) comprising a 
broadcast of a program. 

1 1 . The system as set forth in claim 9, wherein the 
at least one information resource is the world wide web 
and the information resource window (324) displays a list 
of URLs of web sites that are part of the result set of 
search results. 
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12. The system as set forth in claim 9, wherein the 
at least one information resource is the world wide web 
and the information resource window (324) comprises a 
web browser that displays a list of URLs of web sites that 
are part of the result set of search results. 

13. The system as set forth in claim 9, wherein the 
logic is further configured to automatically select filter 
elements (304) for a search from program elements of a 
selected program from the electronic program guide. 

14. The system as set forth in claim 13, further 
comprising an audio/visual window (330) comprising a 
broadcast of a program, wherein the logic is further 
configured to initiate a search in the background when a 
broadcasted program is selected for display in the 
audio/visual window (330). 

15. A computer readable medium containing 
executable instructions which, when executed in a 
processing system, causes the system to perform the steps 
for performing a power search of an electronic program 
guide and at least one information resource, comprising: 

selecting filter elements (304) for a search; 

instituting a search of an electronic program guide 
(306) and the at least one information resource using the 
filter elements (304); 

generating a result set (314) of search results; 
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applying the result set (314) to an electronic 
program guide window (316) to modify the guide to 
indicate those programs that meet the filter elements 
(304); and 

generating an information resource window (324) 
displaying results of the search of the at least one 
information resource based upon the filter elements (304). 

16. The computer readable medium as set forth in 
claim 15, containing further executable instructions which, 
when executed in the processing system comprise 
providing an audio/visual window (330) comprising a 
broadcast of a program. 

17. The computer readable medium as set forth in 
claim 15, wherein the at least one information resource is 
the world wide web and the information resource window 
(324) displays a list of URLs of web sites that are part of 
the result set of search results. 

18. The computer readable medium as set forth in 
claim 15, wherein the at least one information resource is 
the world wide web and the information resource window 
(324) comprises a web browser that displays a list of URLs 
of web sites that are part of the result set of search 
results. 

19. The computer readable medium as set forth in 
claim 15, wherein said instructions for selecting filter 
elements (304) for a search comprises instructions, which 
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when executed by the system, automatically determines 
filter elements (304) from program elements of a selected 
program from the electronic program guide (316). 

20. The computer readable medium as set forth in 
claim 19, wherein the instruction for initiating a search is 
executed in the background when a broadcasted program 
is selected for display. 
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